Spin Domains Generate Hierarchical Ground State Structure in J = ±1 Spin Glasses 
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Unbiased samples of ground states were generated for the short-range Ising spin glass with Jij = ±1, 
in three dimensions. Clustering the ground states revealed their hierarchical structure, which is 
explained by correlated spin domains, serving as cores for macroscopic zero energy "excitations" . 



Mean-field (MF) theory 0] provides a commonly ac- 
cepted description of the low T phase of infinite-range 
spin glasses ||^. It predicts many pure states with an 
hierarchical ultrametric organization and a non-trivial 
state overlap distribution P{q). Although this structure 
was suggested to hold also for short-range spin glasses 
(SRSG) the equiUbrium properties of these are still 
controversial. The main dispute concerns the number of 
different thermodynamic (pure) states of the system be- 
low Tc- Fisher and Huse g studied SRSG with continu- 
ously distributed couplings. According to them, a finite 
region embedded in an infinite system will be in one of 
two pure states. They describe the system's low energy 
excitations above the local ground state as finite flipped 
spin domains. By flipping compact macroscopic domains 
one can generate other pure states. This structure of pure 
states (which we call the FH scenario) yields, for any fi- 
nite region of the infinite system, a trivial P{q) distri- 
bution. Numerical evidence for non-trivial P{q) in finite 
systems does not contradict the FH scenario . 

We present here evidence for a new picture of the spin 
glass phase. It possesses some characteristics of the MF 
description, such as non-trivial P{q) and a hierarchical 
(but non-ultramctric!) structure of the pure states; nev- 
ertheless, it is also consistent with the FH scenario. 

The model: We study the ground states (GS) of the 
Edwards- Anderson model |0| of an Ising spin glass 
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{ij) denotes nearest neighbor sites of a simple cubic lat- 
tice; the values = ±1 are assigned to each bond inde- 
pendently and with equal probabilities [|lO|. Although 
this model is very special - it has highly degenerate 
GS - we expect that its low-T properties are generic, 
i.e. not qualitatively different from other {Jy } distribu- 
tions (such as Gaussian). On the other hand, the low-T 
properties of (|l]) are most probably dominated by the 
structure of its GS. Hence we hope that the GS of the 
J = ±1 model provide insight about the low-T behavior 
of generic short-range Ising spin glass. In any case, the 
GS structure of this model is interesting on its own merit. 



By combining very efficient algorithms 
duce ground states of this model, with simu 



1^ that pro- 
ated temper- 



ing (ST) we generated unbiased samples of the GS; 
i.e. we "equilibrated" our system at T = 0. We studied 
the model (|l|) with periodic boundary conditions in 3 di- 
mensions, with N ^ spins, for L — A,5, 6, 8. For each 
size L we produced 800 to 1000 realizations {J}; for each 
realization an unbiased sample of M — 500 GS has been 
generated and analyzed. 

Summary of the main results: 1. For any given {J}, 
the GS do not cover the hypercube S — {Si, S2, ---Sn) 
uniformly; rather, there is a hierarchical structure, as 
shown schematically in Fig. |l| and in detail in |^. The 
set of all GS splits into two state clusters C and C, re- 
lated by spin reversal; C splits into Ci and C2, and so 
on. 

2. This structure is generated by domains of highly 
correlated spins Q, with very different sizes. Separation 
of GS into C and C is determined by the largest spin 
domain Qi, whose size is typically larger than N/2. Two 
states in which Qi has the same orientation have a much 
higher overlap than two states in which the spins of Qi are 
inverted. This implies formation of two clusters of states, 
C and C, corresponding to the two possible orientations 
of Qi. The same structure persists at the next level, 
where the second largest spin domain Q2 determines 
the partition of C into Ci and C2 (see Fig. ^ . Note that 
Qi has the same orientation in these two clusters. 

3. The hierarchical structure of the GS is due to large 
differences between the sizes of the spin domains (typi- 
cally \Qi \ > 4 1^/2 1). For domains of equal sizes no hierar- 
chy would have been observed. 

4. This picture differs from MF; the correlated do- 
mains determine the overlap distribution, and the GS do 
not exhibit ultrametricity. On the other hand, if in the 
L —> 00 limit all but a vanishing fraction of the spins be- 
long to compact ||l5[| macroscopic correlated domains Qa, 
then any finite region of the infinite system will exhibit a 
trivial P{q), in agreement with the FH scenario (we have 
not tested the compactness of ^a)- 

We explain how this picture of GS structure and spin 
clusters has been found; we present evidence that sub- 
stantiates our findings, investigate their dependence on 
system size and discuss their implications. 

Generating unbiased samples of ground states: For ev- 
ery realization {Jij} we used the genetic cluster exact 
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FIG. 1. Schematic representation of our picture; the two 
largest spin domains and the first two levels in the hierarchical 
organization of the GS are shown. The structure of the GS is 
explained by the spin domains' orientations; e.g. in the GS of 
the two sets Ci,C2, the spins of Qi have the same orientation, 
whereas the spins of the smaller cluster, Q2, have flipped. 



approximation (CEA) algorithm |Q to sample the GS. 
Samples obtained by CEA are, however, biased over 
weighting GS from small valleys (a valley V consists of 
all the GS that can be traversed flipping one spin at a 
time) - therefore the probability to miss a valley is lower 
than that of an unbiased method. We used three meth- 
ods to overcome this bias. For _L = 4, 5 and 6 we suc- 
ceeded, for most realizations {J}, to enumerate exactly 
all GS within each valley; selecting at random M of the 
GS ensures that each valley is represented according to 
its size. For some {J} enumeration was not possible; 
then we used ST to generate samples (our Glauber 
dynamics had a decorrelation time of less than two sam- 
pling periods for each spin). For i = 8 we estimated the 
size of each valley by the method of and generated a 
sample of GS in a valley by a Metropolis MC procedure. 
To test that this method indeed yields unbiased GS, 
we sampled 60 realizations with ST, and ascertained that 
for the quantities of significance for our claims (the size 
of Q2 and the average correlation C12 of the domains - see 
below) the estimates obtained by the two ways did not 
differ significantly and systematically. 

Clustering methodology: Clustering is a powerful way 
to perform exploratory analysis of all kinds of data. In 
general, one calculates a distance matrix dij between the 
i — l,...n data points, and determines the underlying 
hierarchy of partitions (clusters) in the data. We used 
Ward's agglomerative algorithm ||l^; it starts with each 
data point as a separate cluster and at each step fuses 
the pair of clusters a, fi that are at the shortest effective 
distance pap from each other, stopping when all points 
are in one cluster. Initially pap = dap ; when two clusters 
a, (3 are fused, the distances of the new cluster a' to all 
unchanged clusters ^ ^ a.fi are updated 111]: 



_ irig -I- n^)pay + {np + n^)pf3j - n^pap 

Pa'f — , , l^j 

where is the number of points in cluster x. The algo- 
rithm produces a dendrogram such as Fig. ^(a). Leaves 
represent individual data points. The boxes at the nodes 
represent clusters; they are ordered horizontally in a way 
that reflects their proximity. The vertical coordinate of 
cluster a' is T(a') = pap, i.e. the effective distance 
between the two clusters that were fused to form a'. For 
the initial (single state) clusters we set t = 0. When 
we fuse two "natural" clusters, whose separation exceeds 
significantly their linear extent, the branch above them 
is long. Hence we can identify "natural" sub-partitions 
of a cluster; as evident from Fig. ||(a), Ci,C2 are such 
natural sub-partitions of C, and also C, C are natural 
sub-clusters of the set of all GS. For each realization we 
analyzed the data in two ways: 1. viewing the GS as M 
data-points and 2. viewing the spins as A'' data-points. 

Clustering the Ground States: Define = (1 — 

gpy)/2 the distance between states and S"; g^i^ — 
J2i S^S^/N is their overlap. The dendrogram obtained 
by clustering 500 GS for a system with 6^ spins is shown 
in Fig ||(a). Hierarchical GS structure is evident. To 
provide a quantitative measure of the extent to which a 
partition (of, say, C to Ci and C2) is "natural", we eval- 
uate the average distance between points in C and C, 
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and compare it to D(C), the average distance within C. In 
the same manner we define D(Ci,C2), D{Ci) and D{C2)- 
For L~ 6 we obtained D{C) = 0.094(mean)±0.067(s.d.); 
D{C,C) = 0.906±0.067; D{Ci) = 0.057±0.045; D{C2) = 
0.058 ± 0.036; i:'(Ci,C2) = 0.178 ± 0.143._ For L = 8 
we obtained D{C) = 0.078 ± 0.050; D{C,C) = 0.921 ± 
0.050; D{Ci) = 0.049 ± 0.028; D{C2) = 0.049 ± 0.020; 
£)(Ci, C2) = 0.162 ± 0.135. The results clearly show that 
the hierarchical structure is real, and not a mere artifact 
of Ward's algorithm. 

A striking demonstration of this point can be seen in 
Fig. |^(b), which shows the distance matrix Df^i, between 
the GS that were ordered in Fig. ||(a). Dark represents 
short distances and light - high. If we cluster states with 
Si — ±1 at random, the reordered distance matrix is a 
greyish square. Only when the clustered states form a 
real, well defined hierarchy, does the reordered distance 
matrix reveal the structure so clearly seen in Fig. |^(b). 
To understand this hierarchy of GS we investigated the 
organization of the N spins in the M GS. 

Fig. ||(b) resembles the state distance matrix of the 
MF picture. There is, however, one crucial difference. In 
the MF scenario the off-diagonal sub-matrices of the dis- 
tance matrix are uniform^ which leads to ultrametricity 
||l|. For example, if the sub- matrix Dij for i £ Ci and 
j £ C2 is uniform, the width w{Ci,C2) of the distribution 
P{Dij) should vanish as i ^ 00. We performed a fit of 
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FIG. 2. (a) The dendrogram obtained by clustering the 
ground states, for a particular set of J^j, for A'^ = 6^ spins, 
(b) When the states are ordered according to the dendrogram, 
a clear block structure is seen in -D^^, the distance matrix of 
the GS. Darker shades correspond to shorter distances. 



the form w{Ci,C2, L) = Wao + ^, with A and y as fit 
parameters. The minimum of = 6.7 x 10~^ was found 
for Woo = 0.025(2) with y = 3.4(8). Setting w,^ = we 
get a worse fit, with = 1.9 x 10"^. Our data supports 
a non- vanishing value of Woo, in disagreement with the 
ultrametricity of the MF picture. 

Clustering the spins: We cluster i = 1,...,N spin- 
vectors Si = {Sj,Sf, Sj^), looking for correlated spin 
domains. Define a distance between spins i and j by 
dij = 1 — Cij^ , where Cy — Si ■ Sj/M is the correlation 
between spins i and j. Note that Cij^ is the relevant mea- 
sure of correlations in a spin glass. A typical outcome of 
clustering the spins with this distance matrix is the den- 
drogram V of Fig. |3|(a), obtained for the same system, 
whose GS were studied in Fig. |. In Fig. |(b) we show 
the distance matrix obtained after the spins have been 
reordered according to V. Non-trivial structure in spin 
space is evident; dark squares along the diagonal repre- 
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FIG. 3. (a) The dendrogram V obtained by clustering the 
spins of the system of Fig. |2| For this realization ga ~ Ga 
for both a = 1,2. (b) When the spins are ordered according 
to the dendrogram, a structure of correlated spin domains 
emerges; darker shades correspond to shorter distances and 
higher correlations. 



sent highly correlated clusters. 

Identifying Qi and G2- In order to identify Qi, the 
largest domain of correlated spins, we go over all pairs of 
GS, /i, v, with /i G C and v € C, and identify S^jiy, the set 
of spins that have opposite signs in and v. For all L 
and { J}, the set C/^^ is contiguous for more than 99.5% of 
the pairs. Thus, G^i, can be related to the low energy ex- 
citations found for SRSG with Gaussian couplings . 

For a given { J} we identify as Gi the largest contiguous 
group of spins shared by at least a fraction 9 = 0.95 of 
the sets Giiu- Thus, inside Gi Cij^ > 0.81 (for L = 8 the 
average correlation inside Gi is always larger 0.94). The 
second largest spin domain, G2, is found in a similar way, 
by scanning all pairs of GS with /i S Ci and v € €2- As 
seen in Fig. ^, the average sizes of Gi, G2 do not change 
a lot for 0.60 < < 0.95. 

According to our picture we expect \Ga \ L"^ for both 
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FIG. 4. The average sizes of Si (6') and 02(9) ■ The thin 
sohd line presents only ST data for L = 8, which are unbiased 
but highly noisy due to the relatively small number of (60) 
realizations. 
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FIG. 5. Size distribution of Qi and t/2. Note that the dis- 
tribution of t/2 seems to converge already for L = 8. The 
distribution of Qi converges for sizes between 0.5A^ and 0.7N. 



a = 1,2. We present the distributions of \Qa\/L^ for 
4 < L < 8 in Fig. |[ Our results show that the sizes of 
the two largest spin clusters do scale as L^. 

We turn now to identify those clusters gi , 172 in our 
spin dendrogram, which can be associated most naturally 
with the domains Gi,G2- gi is that cluster which is most 
similar to Gi, i.e. has the largest fraction of shared spins 
Sigi^Qi) =2\gir\gi\/i\gi\ + \gi\). The similarity is high: 
for 1/ = 8 on the average we have S{ga, Qa) = 0.99(1) for 
a = 1 and 0.97(4) for a = 2. This means that Qi and Q2 
do have a meaningful role in spin space, and are not just 
an artifact of our analysis. 

Overlap distribution: 

Fig. P strongly suggest that Q2 does not vanish as L 
increases, as one can conclude from |^. Still, the distri- 
bution may become trivial if 



1 



C12 



1^11102 



1 as i 



CO 



(4) 



In this case Qi and Q2 will always flip together. We 
carried out fits of the form ci2{L) = 012(00) — AL~'^ 
as fit parameters. The minimum of is 



1 we have 



2 — 3.4 X 10 Our result 012(00) < 1 should be tested 



with A and 
1.7 X lO-'^ for ci2(oo) 
X 

further for larger systems. The results 
€12(00) < 1 yield a non-trivial P{q) [|l^ 

Summary: The ground states of the ±J short-range 
Ising spin glass have a hierarchical, tree-like structure. 
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This structure is induced by correlated spin domains, 
which are the cores of macroscopic zero energy excita- 
tions, taking the system from one state-cluster to an- 
other. This structure of GS and the associated barriers 
has some features of the MF picture, but is inconsistent 
with it, since it lacks ultrametricity. It is, however, con- 
sistent with the FH scenario. 

Note that evidence for low-energy macroscopic excita- 
tions has been found by ||^; we presented here detailed 
statistics of these domains, investigated their correla- 
tions and demonstrated that they produce an hierarchical 
structure in state space. 
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